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IN THE CLAIMS 



Pie; 



claims as follows: 



Claim 1 (Currently Amended): A method of correcting color of a color image 
obtained by an electronic camera, comprising the steps of: 

determining, using a neural network, a correction to data representative of the color 
image based upon an estimated illuminant of the color image; and 

applying the correction to the data representative of the color image, wherein the 
illuminant comprises multiple sources of illumination including the camera's on-camera R/G 
and B/G illumination estimation data wherein R. G and B are measured signal values for 
illumination color ; 

recording the data representative of the image with data representative of the 
estimated illuminant; and 

transmitting the data representative of the image with the data representative of the 
estimated illuminant. 

Claim 2 (Original): The method of claim 1, wherein the electronic camera captures at 
least one still image. 

Claim 3 (Original): The method of claim 1, wherein the electronic camera captures a 
succession of moving images. 

Claim 4 (Withdrawn): A method of correcting color of a color image obtained by an 
electronic camera, comprising the steps of: 

determining, using a multilayer perceptron model, a correction to data representative 
of the color image based upon an estimated illuminant of the color image; and 
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applying the correction to the data representative of the color image, wherein the 
illuminant comprises multiple sources of illumination. 

Claim 5 (Withdrawn): The method of claim 4, wherein the electronic camera captures 
at least one still image. 

Claim 6 (Withdrawn): The method of claim 4, wherein the electronic camera captures 
a succession of moving images. 

Claim 7 (Withdrawn): The method of claim 4, wherein the multilayer perceptron 
model is trained based upon a dogleg trust region implementation of a Levenberg- Marquardt 
type algorithm. 

Claim 8 (Withdrawn): The method of claim 4, further comprising the step of: 
outputting an output color space of the color corrected image as a space not 
normalized with chromaticity coordinates the sources of illumination. 

Claim 9 (Withdrawn): The method of claim 4, further comprising the step of: 
using training data of each neural network as a colorimetric value under a standard 
source of illumination. 

Claim 10 (Withdrawn): A method of correcting color of a color image obtained by an 
electronic camera, comprising the steps of: 
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determining, using a coactive neuro-fuzzy inference system model, a correction to 
data representative of the color image based upon an estimated illuminant of the color image; 
and 

applying the correction to the data representative of the color image, wherein the 
illxmiinant comprises multiple sources of illumination. 

Claim 1 1 (Withdravm): The method of claim 10, wherein the electronic camera 
captures at least one still image. 

Claim 12 (Withdrawal): The method of claim 10, wherein the electronic camera 
captures a succession of moving images. 

Claim 13 (Withdrawn): The method of claim 10, wherein an integrating unit 
comprised of fuzzy membership functions computes a weighted sum of outputs of local 
expert multilayer perceptrons based upon an on camera estimation of illiomination at a time of 
color image capture. 

Claim 14 (Withdravra): The method of claim 13, further comprising the step of: 
constructing fuzzy membership functions by applying a neural network nonlinear 

coordinate transformation to a white balance plane in order to characterize estimated 

illumination for the coactive neuro-fuzzy inference system model. 

Claim 15 (Withdrawn): The method of claim 10, further comprising the step of: 
training the coactive neuro-fuzzy inference system model by constructing fuzzy 
membership functions generated by applying a neural network nonlinear coordinate 
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transformation to a white balance plane in order to characterize estimated illumination for the 
coactive neuro-fiizzy inference system model. 

Claim 16 (Withdrawn): The method of claim 13, further comprising the step of: 
training the coactive neuro-fuzzy inference system model by constructing fuzzy 
membership functions generated by applying a neural network nonlinear coordinate 
transformation to a white balance plane in order to characterize estimated illumination for the 
coactive neuro-fuzzy inference system model, wherein all parameters of fuzzy membership 
functions and local expert multilayer perceptrons are updated simultaneously. 

Claim 17 (Withdrawn): The method of claim 13, further comprising the step of: 
training the coactive neuro-fuzzy inference system model by constructing fuzzy 
membership functions generated by applying a neural network nonlinear coordinate 
transformation to a white balance plane in order to characterize estimated illumination for the 
coactive neuro-fuzzy inference system model, wherein all parameters of fuzzy membership 
functions and local expert multilayer perceptrons are updated simultaneously in conjunction 
with a heuristic parameter updating rule. 

Claim 18 (Withdrawn): The method of claim 13, 14, 15, 16 or 17, wherein at least 
two of the fuzzy membership functions overlap. 

Claim 19 (Withdrawal): A method of correcting color of a color image obtained by an 
electronic camera, comprising the steps of: 
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determining, using a coactive neuro-fuzzy inference system with a switching unit, a 
correction to data representative of the color image based upon an estimated illuminant of the 
color image. 

Claim 20 (Withdrawn): The method of claim 10, further comprising the steps of: 
finding a color conversion inverse map using separate neural networks associated 

with respective representative sources of illumination; and 

outputting an output color space of the color corrected image as a space not 

normalized with chromaticity coordinates the sources of illumination. 

Claim 21 (Withdrawn): The method of claim 10, further comprising the steps of: 
finding a color conversion inverse map using neural networks associated with 

respective representative sources of illumination; and 

outputting an output color space of the color corrected image as a space not 

normalized with chromaticity coordinates the sources of illumination. 

Claim 22 (Withdrawn): The method of claim 10, further comprising the steps of 
finding a color conversion inverse map using separate neural networks associated 

with respective representative sources of illumination; and 

using training data of each neural network as a colorimetric value under a standard 

source of illumination. 

Claim 23 (Withdrawn): The method of claim 10, further comprising the steps of 
finding a color conversion inverse map using neural networks associated with 
respective representative sources of illumination; and 
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using training data of each neural network as a colorimetric value under a standard 
source of illumination. 

Claim 24 (Currently Amended): An apparatus for correcting color of a color image 
obtained by an electronic camera, comprising: 

a neural network for determining a correction to data representative of the color image 
based upon an estimated illuminant of the color image and for applying the correction to the 
data representative of the color image, wherein the illuminant comprises multiple sources of 
illumination including the camera's on-camera R/G and B/G illumination estimation data 
wherein R. G and B are measured signal values for illumination color ; 

a device capable of recording the data representative of the image with data 
representative of the estimated illuminant; and 

a device capable of transmitting the data representative of the image data with the data 
representative of the estimated illuminant. 

Claim 25 (Original): The apparatus of claim 24, wherein the electronic camera 
captures at least one still image. 

Claim 26 (Original): The apparatus of claim 24, wherein the electronic camera 
captures a succession of moving images. 

Claim 27 (Withdrawn): An apparatus for correcting color of a color image obtained 
by an electronic camera, comprising: 

a multilayer perceptron model for determining a correction to data representative of 
the color image based upon an estimated illuminant of the color image, and for applying the 
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correction to the data representative of the color image, wherein the illuminant comprises 
multiple sources of illumination. 

Claim 28 (Withdrawn): The apparatus of claim 27, wherein the electronic camera 
captures at least one still image. 

Claim 29 (Withdrawn): The apparatus of claim 27, wherein the electronic camera 
captures a succession of moving images. 

Claim 30 (Withdrawn): The apparatus of claim 27, wherein the multilayer perceptron 
model is trained based upon a dogleg trust region implementation of a Levenberg- Marquardt 
type algorithm. 

Claim 31 (Withdrawn): The apparatus of claim 27, wherein the multilayer perceptron 
model outputs an output color space of the color corrected image as a space not normalized 
with chromaticity coordinates the sources of illumination. 

Claim 32 (Withdrawn): The apparatus of claim 27, wherein the multilayer perceptron 
model uses training data of each neural network as a colorimetric value under a standard 
source of illumination. 

Claim 33 (Withdrawn): An apparatus for correcting color of a color image obtained 
by an electronic camera, comprising: 

a coactive neuro-flizzy inference system model for determining a correction to data 
representative of the color image based upon an estimated illuminant of the color image, and 
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for applying the correction to the data representative of the color image, wherein the 
illuminant comprises multiple sources of illumination. 

Claim 34 (Withdrawn): The apparatus of claim 33, wherein the electronic camera 
captures at least one still image. 

Claim 35 (Withdrawn): The apparatus of claim 33, wherein the electronic camera 
captures a succession of moving images. 

Claim 36 (Withdrawn): The apparatus of claim 33, wherein an integrating unit 
comprised of fuzzy membership functions computes a weighted sum of outputs of local 
expert multilayer perceptrons based upon an on-camera estimation of illumination at a time 
of color image capture. 

Claim 37 (Withdrawn): The apparatus of claim 36, wherein fuzzy membership 
functions are constructed by applying a neural network nonlinear coordinate transformation 
to a white balance plane in order to characterize estimated illumination for the coactive 
neuro-fuzzy inference system model. 

Claim 38 (Withdrawn): The apparatus of claim 33, wherein the coactive neuro-fuzzy 
inference system model is trained by constructing fuzzy membership functions generated by 
applying a neural network nonlinear coordinate transformation to a white balance plane in 
order to characterize estimated illumination for the coactive neuro-fuzzy inference system 
model. 
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Claim 39 (Withdrawn): The apparatus of claim 36, wherein the coactive neuro-fuzzy 
inference system model is trained by constructing fuzzy membership functions generated by 
applying a neural network nonlinear coordinate transformation to a white balance plane in 
order to characterize estimated illumination for the coactive neuro-fuzzy inference system 
model, wherein all parameters of fuzzy membership functions and local expert multilayer 
perceptrons are updated simultaneously. 

Claim 40 (Withdrawn): The apparatus of claim 36, wherein the coactive neuro-fuzzy 
inference system model is trained by constructing fuzzy membership functions generated by 
applying a neural network nonlinear coordinate transformation to a white balance plane in 
order to characterize estimated illumination for the coactive neuro-fuzzy inference system 
model, wherein all parameters of fuzzy membership functions and local expert multilayer 
perceptrons are updated simultaneously in conjunction with a heuristic parameter updating 
rule. 

Claim 41 (Withdravm): The apparatus of claim 36, 37, 38, 39 or 40, wherein at least 
two of the fuzzy membership functions overlap. 

Claim 42 (Withdrawn): An apparatus for correcting color of a color image obtained 
by an electronic camera, comprising: 

a coactive neuro-fuzzy inference system with a switching unit for determining a 
correction to data representative of the color image based upon an estimated illuminant of the 
color image. 
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Claim 43 (Withdrawn): The apparatus of claim 33, wherein coactive neuro-fuzzy 
inference system model finds a color conversion inverse map using separate neural networks 
associated with respective representative sources of illumination, and outputs an output color 
space of the color corrected image as a space not normalized with chromaticity coordinates 
the sources of illumination. 

Claim 44 (Withdrawn): The apparatus of claim 33, wherein coactive neuro-fuzzy 
inference system model finds a color conversion inverse map using neural networks 
associated with respective representative sources of illumination, and outputs an output color 
space of the color corrected image as a space not normalized with chromaticity coordinates 
the sources of illumination. 

Claim 45 (Withdrawn): The apparatus of claim 33, wherein coactive neuro-fuzzy 
inference system model finds a color conversion inverse map using separate neural networks 
associated with respective representative sources of illumination, and uses training data of 
each neural network as a colorimetric value under a standard source of illumination. 

Claim 46 (Withdrawn): The apparatus of claim 33, wherein coactive neuro-fuzzy 
inference system model finds a color conversion inverse map using neural networks 
associated with respective representative sources of illumination, and uses training data of 
each neural network as a colorimetric value under a standard source of illumination. 

Claim 47 (Currently Amended): A computer readable recording medium for use with 
a computer having recorded thereon a computer program for correcting color data of a color 
image obtained by an electronic camera, the computer program comprising instructions to: 
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determine, using a neural network, a correction to data representative of the color 
image based upon an estimated illuminant of the color image; 

apply the correction to the data representative of the color image, wherein the 
illuminant comprises multiple sources of illumination including the camera's on-camera R/G 
and B/G illumination estimation data wherein G and B are measured signal values for 
illumination color ; 

record data representative of the corrected data; and 

transmit the data representative of the image with the data representative of the 
estimated illuminant. 

Claim 48 (Previously Presented): The computer readable recording medium of Claim 
47, wherein the electronic camera captures at least one still image. 

Claim 49 (Previously Presented): The computer readable recording medium of claim 
47, wherein the electronic camera captures a succession of moving images. 

Claim 50 (Withdrawn): A computer readable recording medium having recorded 
thereon a computer readable program for correcting color data of a color image obtained by 
an electronic camera, the computer program comprising instruction to: 

determine, using a multilayer perceptron model, a correction to data representative of 
the color image based upon an estimated illuminant of the color image; 

apply the correction to the data representative of the color image, wherein the 
illuminant comprises multiple sources of illumination; and 

record data representative of the corrected data. 
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Claim 51 (Withdrawn): The computer readable recording medium of claim 50, 
wherein the electronic camera captures at least one still image. 

Claim 52 (Withdrawn): The computer readable recording medium of claim 50, 
wherein the electronic camera captures a succession of moving images. 

Claim 53 (Withdrawn): The computer readable recording medium of claim 50, 
wherein the multilayer perceptron model is trained based upon a dogleg trust region 
implementation of a Levenberg-Marquardt type algorithm. 

Claim 54 (Withdrawn): The computer readable recording medium of claim 50, 
further comprising instructions to: 

output an output color space of the color corrected image as a space not normalized 
with chromaticity coordinates the sources of illumination. 

Claim 55 (Withdrawn): The computer readable recording medium of claim 50, 
further comprising instructions to: 

use training data of each neural network as a colorimetric value under a standard 
source of illumination. 

Claim 56 (Withdrawn): A computer readable recording medium having recorded 
thereon a computer readable program for correcting color data of a color image obtained by 
an electronic camera, the computer program comprising instructions to: 

determine, using a coactive neuro-fuzzy inference system model, a correction to data 
representative of the color image based upon an estimated illuminant of the color image; 
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apply the correction to the data representative of the color image, wherein the 
illuminant comprises multiple sources of illumination; and 
record data representative of the corrected data. 

Claim 57 (Withdrawn); The computer readable recording medium of claim 56, 
wherein the electronic camera captxxres at least one still image. 

Claim 58 (Withdrawn): The computer readable recording medium of claim 56, 
wherein the electronic camera captures a succession of moving images. 

Claim 59 (Withdrawn): The computer readable recording medium of claim 56, 
further comprising instructions to compute a weighted sum of outputs of local expert 
multilayer perceptrons based upon an on-camera estimation of illumination at a time of color 
image capture using an integrating unit including fuzzy membership functions. 

Claim 60 (Withdrawn): The computer readable recording medium of claim 59, 
further comprising instructions to: 

construct fuzzy membership functions by applying a neural network nonlinear 
coordinate transformation to a white balance plane in order to characterize estimated 
illumination for the coactive neuro-fuzzy inference system model. 

Claim 61 (Withdrawn): The computer readable recording medium of claim 56, 
further comprising instructions to: 

train the coactive neuro-fuzzy inference system model by constructing fuzzy 
membership functions generated by applying a neural network nonlinear coordinate 
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transformation to a white balance plane in order to characterize estimated illumination for the 
coactive neuro-fuzzy inference system model. 

Claim 62 (Withdrawn): The computer readable recording medium of claim 59, 
further comprising instructions to: 

train the coactive neuro-fuzzy inference system model by constructing fuzzy 
membership functions generated by applying a neural network nonlinear coordinate 
transformation to a white balance plane in order to characterize estimated illumination for the 
coactive neuro-fuzzy inference system model, wherein all parameters of fuzzy membership 
functions and local expert multilayer perceptrons are updated simultaneously. 

Claim 63 (Withdrawn): The computer readable recording medium of claim 59, 
further comprising instructions to: 

train the coactive neuro-fuzzy inference system model by constructing fuzzy 
membership functions generated by applying a neural network nonlinear coordinate 
transformation to a white balance plane in order to characterize estimated illumination for the 
coactive neuro-fuzzy inference system model, wherein all parameters of fuzzy membership 
functions and local expert multilayer perceptrons are updated simultaneously in conjunction 
with a heuristic parameter updating rule. 

Claim 64 (Withdrawn): The computer readable recording medium of claim 59, 60, 
61, 62 or 63, wherein at least two of the fuzzy membership functions overlap. 
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Claim 65 (Withdrawn): A computer readable recording medium having recorded 
thereon a computer readable program for correcting color data of a color image obtained by 
an electronic camera, the computer program comprising instructions to: 

determine, using a coactive neuro-fuzzy inference system with a switching unit, a 
correction to data representative of the color image based upon an estimated illuminant of the 
color image; and 

record on the recording medium data representative of the corrected data. 

Claim 66 (Withdrawn): The computer readable recording medium of claim 56, 
further comprising instructions to: 

find a color conversion inverse map using separate neural networks associated with 
respective representative sources of illumination; and 

output an output color space of the color corrected image as a space not normalized 
with chromaticity coordinates the sources of illumination. 

Claim 67 (Withdrawn): The computer readable recording medium of claim 56, 
further comprising instructions to: 

find a color conversion inverse map using neural networks associated with respective 
representative sources of illumination; and 

output an output color space of the color corrected image as a space not normalized 
with chromaticity coordinates the sources of illumination. 

Claim 68 (Withdrawn): The computer readable recording medium of claim 56, 
further comprising instructions to: 
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find a color conversion inverse map using separate neural networks associated w^ith 
respective representative sources of illumination; and 

use training data of each neural network as a colorimetric value under a standard 
source of illumination. 

Claim 69 (Withdrawn): The computer readable recording medium of claim 56, 
further comprising instructions to: 

find a color conversion inverse map using neural networks associated with respective 
representative sources of illumination; and 

use training data of each neural network as a colorimetric value under a standard 
source of illumination. 

Claim 70 (Currently Amended): A method of transmitting color corrected data of a 
color image obtained by an electronic camera, comprising the steps of: 

determining, using a neural network, a correction to data representative of the color 
image based upon an estimated illuminant of the color image; 

applying the correction to the data representative of the color image, wherein the 
illuminant comprises multiple sources of illumination including the camera's on-camera R/G 
and B/G illumination estimation data wherein R. G and B are measured signal values for 
illumination color ; 

recording data representative of the image with the data representative of the 
estimated illuminant; and 

transmitting data representative of the corrected data. 
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Claim 71 (Original): The method of claim 70, wherein the electronic camera captures 
at least one still image. 

Claim 72 (Original): The method of claim 70, wherein the electronic camera captures 
a succession of moving images. 

Claim 73 (Withdrawn): A method of transmitting color corrected data of a color 
image obtained by an electronic camera, comprising the steps of: 

determining, using a multilayer perceptron model, a correction to data representative 
of the color image based upon an estimated illuminant of the color image; 

applying the correction to the data representative of the color image, wherein the 
illuminant comprises multiple sources of illumination; and 

transmitting data representative of the corrected data. 

Claim 74 (Withdrawn): The method of claim 73, wherein the electronic camera 
captures at least one still image. 

Claim 75 (Withdrawn): The method of claim 73, wherein the electronic camera 
captures a succession of moving images. 

Claim 76 (Withdrawn): The method of claim 73, wherein the multilayer perceptron 
model is trained based upon a dogleg trust region implementation of a Levenberg-Marquardt 
type algorithm. 
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Claim 77 (Withdrawn): The method of claim 73, further comprising the step of: 
outputting an output color space of the color corrected image as a space not normalized with 
chromaticity coordinates the sources of illumination. 

Claim 78 (Withdrawn): The method of claim 73, further comprising the step of: using 
training data of each neural network as a colorimetric value under a standard source of 
illumination. 

Claim 79 (Withdrawn): A method of transmitting color corrected data of a color 
image obtained by an electronic camera, comprising the steps of: 

determining, using a coactive neuro-fuzzy inference system model, a correction to 
data representative of the color image based upon an estimated illuminant of the color image; 

applying the correction to the data representative of the color image, wherein the 
illuminant comprises multiple sources of illumination; and 

transmitting data representative of the corrected data. 

Claim 80 (Withdrawn): The method of claim 79, wherein the electronic camera 
captures at least one still image. 

Claim 81 (Withdravra): The method of claim 79, wherein the electronic camera 
captures a succession of moving images. 

Claim 82 (Withdrawn): The method of claim 79, wherein an integrating unit 
comprised of fuzzy membership functions computes a weighted sum of outputs of local 
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expert multilayer perceptrons based upon an on camera estimation of illumination at a time of 
color image capture. 

Claim 83 (Withdrawn): The method of claim 82, further comprising the step of: 
constructing fuzzy membership functions by applying a neural network nonlinear coordinate 
transformation to a white balance plane in order to characterize estimated illumination for the 
coactive neuro-fuzzy inference system model. 

Claim 84 (Withdrawn): The method of claim 79, further comprising the step of: 
training the coactive neuro-fuzzy inference system model by constructing fuzzy 
membership functions generated by applying a neural nonlinear coordinate transformation to 
a white balance plane in order to characterize estimated illumination for the coactive neuro- 
fuzzy inference system model. 

Claim 85 (Withdrawn): The method of claim 82, further comprising the step of: 
training the coactive neuro-fiizzy inference system model by constructing fuzzy 
membership functions generated by applying a neural network nonlinear coordinate 
transformation to a white balance plane in order to characterize estimated illumination for the 
coactive neuro-fuzzy inference system model, wherein all parameters of fuzzy membership 
functions and local expert multilayer perceptrons are updated simultaneously. 

Claim 86 (Withdrawn): The method of claim 82, further comprising the step of: 
training the coactive neuro-fuzzy inference system model by constructing fuzzy membership 
functions generated by applying a neural network nonlinear coordinate transformation to a 
white balance plane in order to characterize estimated illumination for the coactive neuro- 
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fuzzy inference system model, wherein all parameters of fuzzy membership functions and 
local expert multilayer perceptrons are updated simultaneously in conjunction with a heuristic 
parameter updating rule. 

Claim 87 (Withdrawn): The method of claim 82, 83, 84, 85 or 86 wherein at least two 
of the fuzzy membership functions overlap. 

Claim 88 (Withdrawn): A method of transmitting color corrected data of a color 
image obtained by an electronic camera, comprising the steps of: 

determining, using a coactive neuro-fuzzy inference system with a switching unit, a 
correction to data representative of the color image based upon an estimated illuminant of the 
color image; and 

transmitting data representative of the corrected data. 

Claim 89 (Withdravra): The method of claim 79, further comprising the steps of: 
finding a color conversion inverse map using separate neural networks associated 

with respective representative sources of illumination; and 

outputting an output color space of the color corrected image as a space not 

normalized with chromaticity coordinates the sources of illumination. 

Claim 90 (Withdrawn): The method of claim 79, further comprising the steps of: 
finding a color conversion inverse map using neural networks associated with 

respective representative sources of illumination; and 

outputting an output color space of the color corrected image as a space not 

normalized with chromaticity coordinates the sources of illumination. 
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Claim 91 (Withdrawn): The method of claim 79, further comprising the steps of: 
finding a color conversion inverse map using separate neural networks associated 

with respective representative sources of illumination; and 

using training data of each neural network as a colorimetric value under a standard 

source of illumination. 

Claim 92 (Withdrawn): The method of claim 79, further comprising the steps of: 
finding a color conversion inverse map using neural networks associated with 

respective representative sources of illumination; and 

using training data of each neural network as a colorimetric value under a standard 

source of illumination. 

Claim 93 (Original): The method of claim 1, 4 or 10, wherein the data representative 
of the color image includes information regarding the illuminant. 

Claim 94 (Original): The apparatus of claim 24, 27 or 33, wherein the data 
representative of the color image includes information regarding the illuminant. 

Claim 95 (Currently Amended): A method of recording image data obtained by an 
electronic camera, comprising the steps of: 

capturing a color image and generating data representative of the image; 

estimating an illuminant for the captured color image and generating data 
representative of the estimated illuminant wherein the illuminant comprises multiple sources 



22 



Application No. 09/719,950 

Reply to Office Action of May 30, 2006 



of illumination that includes the camera's on-camera R/G and B/G illumination estimation 
data wherein R, G and B are measured signal values for illumination color ; 

recording the data representative of the image with the data representative of the 
estimated illuminant; and 

transmitting the data representative of the image with the data representative of the 
estimated illuminant. 

Claim 96 (Canceled). 
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